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Abstract 

Population protocols have been introduced by Angluin et al. as a 
model of networks consisting of very limited mobile agents that interact 
in pairs but with no control over their own movement. A collection 
of anonymous agents, modeled by finite automata, interact pairwise 
according to some rules that update their states. Predicates on the 
initial configurations that can be computed by such protocols have 
been characterized as semi-linear predicates. 

In an orthogonal way, several distributed systems have been termed 
in literature as being realizations of games in the sense of game theory. 
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We investigate under which conditions population protocols, or 
more generally pairwise interaction rules, correspond to games. 

We show that restricting to asymetric games is not really a restric- 
tion: all predicates computable by protocols can actually be computed 
by protocols corresponding to games, i.e. any semi-linear predicate can 
be computed by a Pavlovian population multi-protocol. 

1 Introduction 

The computational power of networks of anonymous resource-limited mo- 
bile agents has been investigated recently. Angluin et al. proposed in [3] the 
model of population protocols where finitely many finite-state agents interact 
in pairs chosen by an adversary. Each interaction has the effect of updating 
the state of the two agents according to a joint transition function. A proto- 
col is said to (stably) compute a predicate on the initial states of the agents 
if, in any fair execution, after finitely many interactions, all agents reach a 
common output that corresponds to the value of the predicate. 

The model has been originally proposed to model computations realized 
by sensor networks in which passive agents are carried along by other enti- 
ties. Variants of the original model considered so far include restriction to 
one-way communications [1], restriction to particular interaction graphs [2], 
random interactions [3], with "speed" [7|. Various kinds of fault tolerance 
have been considered for population protocols [10] , including the search for 
self-stabilizing solutions [5]. Solutions to classical problems of distributed 
algorithms have also been considered in this model (see [18|). 

Most of the works so far on population protocols have concentrated on 
characterizing which predicates on the initial states can be computed in 
different variants of the model and under various assumptions [18]. In par- 
ticular, the predicates computable by the unrestricted population protocols 
from |3j have been characterized as being precisely the semi-linear predicates, 
that is those predicates on counts of input agents definable in first-order 
Presburger arithmetic |3l H] . 

In an orthogonal way, pairwise interactions between finite-state agents 
are sometimes motivated by the study of the dynamics of particular two- 
player games from game theory. For example, the work in [llj considers 
the dynamics of the so-called PAVLOV behavior in the iterated Prisoners' 
Dilemma. Several results about the time of convergence of this particular 
dynamics towards the stable state can be found in [11], and [12], for rings, 
and complete graphs [16] with having various classes of adversarial sched- 
ulers [15] . 

Our purpose is to better understand whether and when pairwise inter- 
actions, and hence population protocols, can be considered as the result of 
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a game. We prove the result that restricting to games is not really a re- 
striction: all predicates computable by protocols can actually be computed 
by protocols corresponding to games, i.e. any semi-linear predicate can be 
computed by a Pavlovian population multi-protocol. 

In Section [21 we recall population protocols. In Section [31 we give some 
basics from game theory. In Section [H we discuss how a game can be 
turned into a dynamics, and introduce the notion of Pavlovian population. 
In Section [5] we state our main result: any semi- linear predicate can be 
computed by a Pavlovian population multi-protocol. Remaining sections 
correspond to its proof: we prove that threshold and modulo predicates can 
be computed respectively in Sections [6] and [3 

Related Works. As we already said, population protocols have been intro- 
duced in |3j, and proved to compute all semi-linear predicates. They have 
been proved not to be able to compute more in 0]. Various restrictions on 
the initial model have been considered up to now. An survey can be found 
in [IE]. 

More generally, population protocols arise as soon as populations of 
anonymous agents interact in pairs. Our original motivation was to con- 
sider rules corresponding to two-player games, and population protocols 
arose quite incidentally. The main advantage of the [3] settings is that it 
provides a clear understanding of what is called a computation by the model. 
Many distributed systems have been described as the result of games, but 
as far as we know there has not been attempt to characterize what can be 
computed by games in the spirit of this computational model. 

In this paper, we turn two players games into dynamics over agents, by 
considering PAVLOV behavior. This is inspired by [1 H I12 1 1T7] that consider 
the dynamics of a particular set of rules termed the PAVLOV behavior in 
the iterated Prisoners' Dilemma. The PAVLOV behavior is sometimes also 
termed WIN-STAY, LOSE- SHIFT Notice, that we extended it from 

two-strategies two-player games to n-strategies two-player games, whereas 
above references only talk about two-strategies two-player games, and mostly 
of the iterated Prisoners' Dilemma. This is clearly not the only way to asso- 
ciate a dynamic to a game. Alternatives to PAVLOV behavior could include 
MYOPIC dynamics (at each step each player chooses the best response to 
previously played strategy by its adversary), or the well-known and stud- 
ied FICTIOUS-PLAYER dynamics (at each step each player chooses the 
best response to the statistics of the past history of strategies played by its 
adversary). We refer to [13^ i8j for a presentation of results known about 
the properties of the obtained dynamics according to the properties of the 
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underlying game. This is clearly non-exhaustive, and we refer to j6] for a 
zoology of possible behaviors for the particular iterated Prisoners' Dilemma 
game, with discussions of their compared merits. 

Recently Jaggard et al. [16j studied a distributed model similar to proto- 
col populations where the interactions between pairs of agents correspond to 
a game. Unlike in our model, each agent has there its own pay-off matrix and 
has some knowledge of the history. This work gives several non-convergence 
results. 

In this paper we consider possibly asymmetric games. In a recent paper 
[9] we discussed population protocols corresponding to Pavlovian strategies 
obtained from symmetric games and we gave some protocols to compute 
some basic predicates. Unlike what we obtain here, where we prove that any 
computable predicate is computable by a asymmetric Pavlovian population 
protocol, restricting to symmetric games seems a (too) strong restriction 
and most predicates (e.g. counting up to 5, to check where x = mod 2) 
seems not even computable. 

2 Population Protocols 

A protocol [3j is given by {Q,T,, l,uj, 5) with the following components. Q 
is a finite set of states. S is a finite set of input symbols, t : S — )• Q is the 
initial state mapping, and a; : Q — )• {0, 1} is the individual output function. 
6 C is a joint transition relation that describes how pairs of agents can 
interact. Relation 6 is sometimes described by listing all possible interactions 
using the notation (^1,92) — ^ {QijQ-z)^ even the notation qiq2 — > q'iq2, 
for (qi,q2,Qi,Q2) ^ ^ (with the convention that {qi,q2) {QiyQ2) when 
no rule is specified with (51,^2) in the left-hand side). The protocol is 
termed deterministic if for all pairs ((/i,(/2) there is only one pair {q'i,q'2) 
with {qi,q2) {QitQ2)- that case, we write Si{qi,q2) for the unique q'l 
and 52(^1,^2) for the unique (72- 

Computations of a protocol proceed in the following way. The compu- 
tation takes place among n agents, where n > 2. A configuration of the 
system can be described by a vector of all the agents' states. The state of 
each agent is an element of Q. Because agents with the same states are 
indistinguishable, each configuration can be summarized as an unordered 
multiset of states, and hence of elements of Q. Each agent is given initially 
some input value from S: Each agent's initial state is determined by ap- 
plying i to its input value. This determines the initial configuration of the 
population. 

An execution of a protocol proceeds from the initial configuration by 
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interactions between pairs of agents. Suppose that two agents in state qi 
and q2 meet and have an interaction. They can change into state q'l and 
q2 if (91, 92) 92) is in the transition relation 5. If C and C are two con- 
figurations, we write C — ?> C if C can be obtained from C by a single 
interaction of two agents: this means that C contains two states qi and 
q2 and C is obtained by replacing qi and q2 by q'l and ^2 in C, where 
iQi:Q2,Q'nQ2) ^ ^- An execution of the protocol is an infinite sequence 
of configurations Co, Ci, C2, • • • , where Co is an initial configuration and 
Cj — )• Cj+i for all i > 0. An execution is fair if for every configuration C 
that appears infinitely often in the execution, if C ^ C for some configura- 
tion C, then C appears infinitely often in the execution. As proved in [1], 
the fairness condition implies that any global configuration that is infinitely 
often reachable is eventually reached. 

At any point during an execution, each agent's state determines its out- 
put at that time. If the agent is in state q, its output value is u}{q). The 
configuration output is (resp. 1) if all the individual outputs are (resp. 
1). If the individual outputs are mixed Os and Is then the output of the 
configuration is undefined. 

Let p be a predicate over multisets of elements of S. Predicate p can 
be considered as a function whose range is {0, 1} and whose domain is the 
collection of these multisets. The predicate is said to be computed by the 
protocol if, for every multiset /, and every fair execution that starts from 
the initial configuration corresponding to I, the output value of every agent 
eventually stabilizes to p{I)- Predicates can also be considered as functions 
whose range is {0, 1} and whose domain is N'^' . The following is then known. 

Theorem 1 ([3^,14]) A predicate is computable in the population protocol 
model if and only if it is semilinear. 

Recall that semilinear sets are exactly the sets that are definable in first- 
order Presburger arithmetic |20j . 

3 Game Theory 

We now recall the simplest concepts from Game Theory. We focus on non- 
cooperative games, with complete information, in normal form. 

The simplest game is made up of two players, called / (or initiator) and 
R (or responder), with a finite set of actions, called pure strategies, Strat{I) 
and Strat{R). Denote by Aij (resp. Bij) the score for player / (resp. 
R) when / uses strategy i E Strat{I) and R uses strategy j G Strat{R). 
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The scores are given by n x m matrices A and B, where n and m are the 
cardinahty of Strat{I) and Strat{R). 

A strategy x in Strat{I) is said to be a best response to strategy y in 
Strat{R), denoted by x G BRA{y) if A^^y < A^^y for all strategies z G 
Strat{I). Conversely, a strategy y G Strat{R) satisfies y G BRb{x) if 
-Ba;,z < foi" 3-11 strategies z G Strat{R). A pair (a;,y) is a (pure) Nash 
equilibrium if x G BR^iy) and y G BRb{x). In other words, two strategies 
(x, y) form a Nash equilibrium if in that state neither of the players has a 
unilateral interest to deviate from it. 

There are two main approaches to discuss dynamics of games. The first 
consists in repeating games [8j. The second in using models from evolution- 
ary game theory. Refer to |141 [2T] for a presentation of this latter approach. 

Repeating k times a game, is equivalent to extending the space of actions 
into Strat{I)^ and Strat{R)^: player / (respectively R) chooses his or her 
action x(t) G Strat{I), (resp. y(t) G Strat{R)) at time t for t = 1,2, ■ ■ ■ ,k. 
This is equivalent to a two-player game with respectively and m'^ choices 
for players. 

In practice, player / (respectively R) has to solve the following problem 
at each time t: given the history of the game up to now, that is to say 
Xt-i = x(l), • • • ,x(i — 1) and Yt-i = y(l), ■ ■ ■ ,y{t — 1) what should I (resp. 
R) play at time t7 In other words, how to choose x(t) G Strat{I)l (resp. 
y{t) G Strat{R)l) 

Is is natural to suppose that this is given by some behavior rules: x(i) = 
f{Xt-i,Yt-i) and y{t) = g{Xt-i,Yt-i) for some particular functions / and 
9- 

The question of the best behavior rule to use in games, in particular for 
the Prisoners' Dilemma gave birth to an important literature. In particular, 
after the book [6j , that describes the results of tournaments of behavior rules 
for the iterated Prisoners' Dilemma, and that argues that there exists a best 
behavior rule called TIT — FOR — TAT. This consists in cooperating at 
the first step, and then do the same thing as the adversary at subsequent 
times. A lot of other behaviors, most of them with very picturesque names 
have been proposed and studied: see for example j6]. 

Among possible behaviors there is PAVLOV behavior: in the iterated 
Prisoners' Dilemma, a player cooperates if and only if both players opted 
for the same alternative in the previous move. This name [6l [T71 [T9] stems 
from the fact that this strategy embodies an almost reflex-like response to the 
payoff: it repeats its former move if it was rewarded above a threshold value, 
but switches behavior if it was punished by receiving under this value. Refer 
to [19] for some study of this strategy in the spirit of Axelrod's tournaments. 
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The PAVLOV behavior can also be termed WIN- STAY, LOSE-SHIFT since 
if the play on the previous round results in a success, then the agent plays 
the same strategy on the next round. Alternatively, if the play resulted in a 
failure the agent switches to another action |6l [19] . 

4 From Games To Population Protocols 

In the spirit of the previous discussion, to any game, we can associate a 
population protocol as follows, corresponding to a PAVLOV {iw) behaviour: 

Definition 1 (Associating a Protocol to a Game) Assume a (possibly 
asymmetric) two-player game is given. Let A and B he the corresponding 
matrices. Let A he some threshold. 

The protocol associated to the game is a population protocol whose set of 
states is Q, where Q = Strat{I) = Strat{R) is the set of strategies of the 
game, and whose transition rules 5 are given as follows: {qi,q2,Qi,Q2) S ^ 
where 

• Qi = Qi when Aq-^^^q^ > A, * Q2 = Q2 when Bq^^q-^ > A, 

* q'l € BRA{q2) when Aq-^^^q^ < A, * Q2 ^ BRB{qi) when Bq^^q-^ < A. 

Definition 2 (Pavlovian Population Protocol) A population protocol is 
Pavlovian if it can he ohtained from a game as above. 

A population protocol obtained from a game as above will be termed 
deterministic if best responses are assumed to be unique; in this case, the 
rules are deterministic: for all qi,q2, there is a unique q'l and a unique 
such that {qi,q2,qi,q2) € S. 

In order to avoid to talk about matrices, we start by stating some struc- 
tural properties of Pavlovian population protocols. 

Proposition 1 Consider a set of rules. For all rules ab a'b' , we denote 
6^{b) = b' and 5^(a) = a' . Let Stable^{a) = {x € Q\5l^{x) = x}, and 
Stable^{a) = {x G (x) = x}. 

Then the set of rules is deterministic Pavlovian iffia G Q 3 max^{a) G 
Stable^ (a) and 3 max^{a) G Stable^ (a) such that for all states a, 

L yb ^ Stable^ (a) implies (5^(6) = max^(a). 

2. V5 Stable^{a) implies 5^{b) = max^{a). 
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Proof: First, we consider a Pavlovian population protocol P obtained 
from corresponding matrices A and B. Let A be the associated threshold. 
Let a be an arbitrary state in Q, and let q be the best response to strategy 
a for matrix B. 

Focus on the rule aq a'q' where {a',q') £ Q^, i.e., focus on the case 
where player / plays a while player R plays q. As q = BRsia), we have, by 
Definition [U q' equals to q. Thus, q € Stable^ {a). 

Now, let consider b such that b ^ Stable^ (a). We focus on the rule 
ab a"b' where {a",b') S Q^. So by definition of set Stable^, we have 
b ^ b' . Using Definition [H we have Bf, a < A and b' = BRsia)- So 
b' = BRsia) = q. Thus, if we let max\a) = q, max\a) satisfies the 
conditions of the proposition. 

Using similar arguments, we can also prove that 3 max^{a) € Stable^{a) 
such that V6 Stable^ {a) implies (5^(6) = max^{a). In fact, we can sum 
up the relationship between the game matrix and rules by the following: 
for any a G Q, we have Stable^ (a) = {x € Q\Bx^a > A} U {BRsia)} and 
max^{a) = BRsia) and Stable^{a) = {x G Ql^x.a > A} U {BRA{a)} and 
max^{a) = BRA{a). 

Conversely, consider a population protocol P satisfying the properties of 
the proposition. All rules ab — >■ a'b' are such that (5^(6) = b' and 5^ (a) = a'. 
We focus on the construction on a two-player game having the corresponding 
matrices A, and B. We fix an arbitrary value A as the threshold of the 
corresponding game. 

• If Stable^ (a) 7^ Q, then B^^^i^^^-^^^ = A + 1. If x G Stable^ (a) and if 
X 7^ max\a) then B^^a = A. If x ^ Stable\a), then B^^a = A — 1. 

• If Stable^ (a) = Q, then Vx G Q, B^^a = A. 

• If Stable^{a) 7^ Q, then ^max«(a),a = A + 1. If x G Stable^{a) and if 
X 7^ max^{a) then Ax^a = A. If x ^ Stable^{a), then Ax^a = A — 1. 

• If Stable^ (a) = Q, then Vx G Q, Aa;,a = A. 

It is easy to see that this game describes all rules of P. So, P is a Pavlovian 
population Protocol. □ 

5 Main Result 

Inverting value of the individual output function, the class of predicates com- 
putable by a Pavlovian population protocol is clearly closed under negation. 
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However, this is not clear that predicates computable by Pavlovian popula- 
tion protocols are closed under conjunction or disjunction. 

This is true if one considers multi-protocol The idea is to consider k 
(possibly asymmetric) two-player games. At each step, each player chooses 
a strategy for each of the k games. Now each of the k games is played 
independently when two agents meet. Formally: 

Definition 3 (Multiprotocol) Consider k (possibly asymmetric) two-player 
games. For game i, let Q* he the corresponding states, and the corre- 
sponding matrices. 

The associated population protocol is the population protocol whose set 
of states is Q = X Q"^ X . . . X , and whose transition rules are given 
as follows: {{ql, . . . ■ ,Q2)dQi ^ ■ ■ ■ ^Qi )AQ2 ^ ■ ■ ■ ^Qi)) where, 

for all 1 < i < k, {q\,q2,Qi )'?2 ) ^ transition of the Pavlovian population 
protocol associated to the ith game. 

Notice that, when considering population protocols, a multi-protocol is 
a particular population protocol. This is the key property used in [3] to 
prove that stably computable predicates are closed under boolean opera- 
tions. When considering Pavlovian games, one can build multi-protocols 
that are not Pavlovian protocols, and it is not clear whether one can al- 
ways transform any pavlovian multi-protocol into an equivalent pavlovian 
protocol. 

As explained before, multisets of elements of S = (ui, . . . , o"/) are in bi- 
jection with elements of N', and can be represented by a vector (xi, . . . , x;) 
of non-negative integers where Xj is the number of occurrences of cjj in the 
multiset. Thus, we consider predicates ip over vectors of non-negative in- 
tegers. We write [ip] for their characteristic functions. Recall that a pred- 
icate is semi-linear iff it is Presburger definable [20]. Semi-linear predicate 
correspond to boolean combinations of threshold predicates and modulo 
predicates defined as follows (variables Xi represent the number of agents 
initially in state cxj): A threshold predicate is of the form [SajXj > k], where 
Vi, Oj € Z, € Z and the XjS are variables. A modulo predicate is of the 
form [SajXj = b mod k], where Vi, Oj G Z, A; G N \ {0, 1}, 6 G [1, A; — 1] and 
the XiS are variables. 

We can then state our main result: 

Theorem 2 For any predicate the following conditions are equivalent: 

• ip is computable by a population protocol 

• ij) is computable by a Pavlovian population multi-protocol 
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• ip is semi-linear. 

The proof of the following proposition can be found in Appendix lA.li 

Proposition 2 The class of predicates computable by multi-games are closed 
under boolean operations. 

As from Proposition [21 predicates computable by Pavlovian population 
multi-protocols are closed under boolean operations, and as a Pavlovian pop- 
ulation protocol is a particular Pavlovian population multi-protocol, and as 
predicates computable by (general) population protocols are known to be ex- 
actly semi- linear predicates, to prove Theorem [2] we only need to prove that 
we can compute threshold predicates and modulo predicates by Pavlovian 
population protocols. This is the purpose of the following sections. 

6 Threshold Predicates 

In this section, we prove that we can compute threshold predicates using 
Pavlovian protocols. 

Proposition 3 For any integer k, and any integers 01,02,- •• ,Om there 
exists a Pavlovian population protocol that computes [Y^^Li (^i^i — 

First note, that we can assume without loss of generality that A; > 1. 
Indeed, [SojXj > —k] = ['E{—ai)xi < k] = Oj)a;j < A; + 1] which is the 
negation of aj)xj > A; + 1]. Thus from a population protocol computing 
ai)xi > A: + 1] with k > 0, we just have to inverse the output function 
to obtain a population protocol that computes [SojXj > —k]. 

The purpose of the rest of this section is to prove Proposition [3l We first 
discuss some basic ideas: Our techniques are inspired by the work of Angluin 
et al. ^J. The set of states we use is the set of integers from [— M, M] where 
M = max(|aj|, 2k — 1). Each agent with input (jj is given an initial weight of 
Oj . During the execution, the sum of the weights over the whole population 
is preserved. In [3], the general idea is the following: two interacting agents 
with positive weights p and q such that p + q < M are transformed into an 
agent with weight and an agent with weight p + while two agents with 
weight p and q such that p + q > M are transformed into two agents with 
weight \ {p + q)/2\ and \{p + q)/2\ that are both greater or equal to k. 

In our setting, we cannot use the same rules since all agents that change 
their states when they meet an agent in state p while being initiator (resp. 
responder) must take the same state that only depends of p. To avoid this 
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problem, a trick is to use rules of the following form: pq (p + — !)■ 
However, we also have to make sure that the protocol enables all agents to 
agree in the final configuration. Whereas this kind of consideration is easy 
in the classical population protocol model, this turns out to be tricky in our 
settings. 

We describe a protocol that computes [X^I^i ^i^i — Our protocol is 
defined as follows: we consider S = {cji, . . . , ai}, Q = {T} U [— M, M]; for 
all i, i{ai) = Oj; and we take tij(T) = 1 and for any p £ [—M, M], a;(p) = 1 
if and only if p > 1 . 

We distinguish two cases: either A; = 1, or A; > 2. We present two 
protocols here, because we need to have a mechanism in our protocols to 
enable to "broadcast" the result; this is not so difficult in the first case 
whereas it is more technical in the second one. Due to lack of space, we 
only give the rules for k = 1 (the proof can be found in Appendix IA.2p . but 
provide a full proof for the case k >2. 

Case k = 1. Our protocol computing [SajXj > 1] is defined as follows (see 
Appendix IA.2p . The rules are the following. 



TT- 
IT- 



\fn e [-M,0],Vpe [2,M-l] 
nT— s> nO 

nx -^nx Vx e [-M, M] , 



Tx- 
In- 
Ip- 

pT- 
pn- 
pp'- 



> Tx 

> (n + l)T 
. Ip 

> pT 

>{n + l)ip-l) 

> pp' 



\/x G [~M, M] 
Vn e [-M, 0] 
Vpe [1,M] 



\/p' e [l,M] 



Case k > 2. Our protocol is deterministic and from Proposition [T] uniquely 
determined by the sets Stable^ (q), Stable^{q), and by the values max^{q), 



max 



(q) defined as follows. 



qeQ 


Stable' (q) 


max' (q) 


Stable'^iq) 


max''^[q) 


T 


{T}U[-M,0] U [fc,Af] 


-1 


{T}U [-Af,A//] 




n e [-A/,-1] 


[-M, M] 





{T}U[-Af,0] 


{n + l) 





[-M, M] 





{T} U [-M, fc - 1] 


1 


1 


{T,0,M} 


T 


[-Af,0] 


2 


[2,fc-i] 


{T,0,M} 


(p-1) 


[-M,0] 


(p+1) 


b e [k, M - 1] 


{T}U[fc,A/] 


(6-1) 


{T} U [-Af , 0] U [k, M] 


(6+1) 


M 


{T}U[fc,A/] 


(A/ - 1) 


{T}U [-Af,Af] 





The transition rules we obtain from these sets and values are the follow- 



ing. 
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TT^ 


TT 




Ta;— >-Ta; 


Tp— ; 




Vpe [i,fc-i] 




IT^ 


IT 




10 ^10 




• (a; + l)T 


Va; ^ {T,0,M} 


IM^^IM 


Vp e [2, /c - 1] 








pT-) 


pT 




px —^{x + l){p 


pO -) 


pO 




pM^pM 


Vn e [-M, 0] 








nT-s 


nO 




nx -^nx 


V6 G [fc, M] 










bT 




bb' -^bb' 


bx -) 


.{x + l){b-l) 


Vx e [-M, - 1] 





Va; e [-M, 0] U [fc, M] 



Va; € [-M, M] 
V6' e [fc, M] 



We say that an agent in state x G [— M, M] has weight a; and that an 
agent in state T has weight 0. Note that in the initial configuration the sum 
of the weights of aU agents is exactly SaiXj. Note that any of the rule of 
our protocol does not modify the total weight of the population, i.e., at any 
step of the execution, the sum of the weights of all agents is exactly SajXj. 

Note that the stable configurations, (i.e., the configurations where no 
rule can be applied to modify the state of any agent), are the following: 

• every agent a is in some state n(a) G [— M, 0], 

• a unique agent is in state p & [l,fe — 1] and every other agent is in 
state 0. 

• every agent a is either in some state 6(a) G [fc, M] or in state T. 

Note that no agent starts in state T, and that no rule enables the two 
interacting agents to enter the state T except for the rule TT TT. Thus, 
we know that it is impossible that all agents are in state T. Consequently, 
in the last case described, we know that there is at least one agent in a state 

6 G [k,M]. 

Note that in any stable configuration, all agents have the same output; 
if SajXj > k then all agents output 1, while in all the other cases, the agents 
output 0. Thus, if the population reaches a stable configuration, we know 
that the computed output is correct and that it will not be modified any 
more. Now, we should prove that the fairness condition ensures that we 
always reach a stable configuration. In fact, it is sufficient to prove that 
from any reachable configuration, there exists an execution that reaches a 
stable configuration. 

Consider any configuration reached during the execution. As long as 
there is an agent in state p G [1, M] and an agent in state n G [— M, —1], we 
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apply pn (n + — 1). Thus we can always reach a configuration where 
the states of all agents are in [— M, 0] U {T} if SajXj < 0, or in [0, M] U {T} 
otherwise. 

If SajXj < 0, then there is at least one agent in state n G [— M, 0], since 
all agents cannot be in state T. In this case, applying iteratively the rule 
nT —7- nO, we reach a stable configuration where all agents have a state in 
[-M,0]. 

Suppose now that T,aiXi G [1, A; — 1]. Since T,aiXi G [1, A; — 1], each agent 
with a positive weight is in a state in [l,k — 1]. Applying iteratively the 
rule pp' [p — + 1) where p,p' € [1, A; — 1], we reach a configuration 
where there is exactly one agent in state p G — 1] while all the other 
agents are in state or T. Applying iteratively the rules Tp (p + 1) 
and [p + 1)(— 1) Op, we reach a configuration where one agent is in state 
p G [1, A; — 1] while all the other agents are in state 0. 

Finally, assume that SajXj > k. If there is an agent in state p G [1, A; — 1], 
we know that there is at least another agent in state q G [1, M]. lip-\-q < M, 
applying iteratively the rule pq ^ {p — l){q + I) between these two agents, 
we reach a configuration where one of these two agents is in state while the 
other is in state p + q. In this case, we have strictly reduced the number of 
agents in a state in [1, A;—!], lip+q > M > 2k, then q G [A;, M], and applying 
iteratively the rule qp ^ {q — l){p + 1), we reach a configuration where one 
agent is in state k while the other agent is in state p + q — k G [A;, 2M]. Here 
again, we have strictly reduced the number of agents in a state in [1, A; — 1]. 
Applying these rules as long as there exists an agent in state p G [1, A: — 1], 
we reach a configuration where all agents are either in a state in [A;, M], or 
in state or T. Since SajXj G [A;, M], we know there exists an agent in state 
h G [A;, M\. Applying iteratively the rules 50 — > 1(6 — 1) and 1(6 — \) ^ 6T, 
we reach a stable configuration where all agents are either in state T or in 
a state in [k, M\. 

7 Modulo Counting 

Proposition 4 For any integers k, h, and any integers ai, 02, • • • , there 
exists a Pavlovian population protocol that computes [X^I^i '^i^i = b mod A;] . 

Due to lack of space, we only give the rules of the protocol for the case 
when 6 G [1, A; — 1] (see Appendix I A . 31 for the complete proof). In that case, 
our protocol is defined as follows: S = {ai, . . . ,ai}, Q = {T} U [0, A; — 1]; 
for all i, let i((Tj) = mod k; let uj{T) = 1 and for any p G [0, A; — 1], let 
u){p) = 1 if and only if p = b. 
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The rules are the following: 



TT ^ TT 
bT bT 
OT ^ OT 



TO-^ 00 

Ob^ T(fc - 1) if 6 = fc - 1 
Ob^{b+l){k-l) iib^k-1 



Vpe [l,fc-l] 

Tp — > Tp 
p(fc-l)^T(p-l) 

Vp e [0, fc - 1] \ {b} 

Op -> Op 



pp'^ pp' Vp' G [0,p - f] 

pp'^{p' + 1) (p - i) vy e [p, fc - 2] 



pT^ l(p-l) 



8 Conclusion 

In this work, we present some (original an non-trivial) Pavlovian population 
protocols that compute the general threshold and modulo predicates. From 
this, we deduced that a predicate is computable in the Pavlovian population 
multi-protocol model if and only if it is semilinear. 

In other words, we proved that restricting to rules that correspond to 
asymmetric games in pairwise interactions is not a restriction. 

We however needed to consider multi-protocols, that is to say multi- 
games. We conjecture that the Pavlovian population protocols (i.e. non- 
multi-protocol) can not compute all semilinear predicates. A point is that 
in such protocols the set of rules are very limited (see Proposition [T]) . In 
particular, it seems rather impossible to perform an "or" operation between 
two modulo predicates in the general case. 

Notice that the hypothesis of asymmetric games seems also necessary. 
We studied symmetric Pavlovian population protocols in |9j where we demon- 
strated that some non-trivial predicates can be computed. However, even 
very basic predicates, like the threshold predicate counting up to 5, seems 
problematic to be computed by symmetric games. With asymmetric games, 
general threshold and modulo predicates can be computed. 
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A Proofs 



The following proofs are here for completeness of the refereeing process. 
A.l Proof of Proposition [2] 

The negation is easy to deal with, as we just need to change u into 1 — u. 
From de Morgan's laws, we only need to prove closure by conjunction. 

For the conjunction of two multi-games, let consider the multi-game in- 
cluding all the games present in the two initial multi- games. The conjunction 
protocol is the one associated to the new multi-game with output function 

^'{q\ • • • , • • • = ...,q^)* uj2{p\ ■ ■ ■ 

where {q^, . . . ,q^) and {p^, . . . are the corresponding games in the first 
and second multi-games, and uji and lj2 the respective output functions. 

A. 2 Proof of Our Protocol for Threshold Predicates when 

k = 1 

Our protocol computing [Sa^Xi > 1] is defined as follows: 

• S = {cji, . . .,ai}. 

• Q = {T} U [— M, M], where T corresponds to a weight of but has a 
different output meaning than the state 0. 

• i^(T) = 1 and for any p G [— M, M], u}{p) = 1 if and only if p > 1. 

Our protocol is deterministic and from Proposition [T] uniquely deter- 
mined by the sets Stable^ {q), Stable^ {q), and by the values max^{q), max^ {q) 
defined as follows. 



q€Q 


Stable' (q) 


max' (q) 


Stable'^{q) 


max'^iq) 


T 


{T} U [-M, M] 




{T}U [-M,M] 




n E [-M, -1] 


[-M, M] 





{T}U[-M,0] 


(n+1) 





[-M, M] 





{T}U[-M, 1] 


1 


1 


{T}U[1,M] 


T 


{T}U [-M,M] 




pe[2,M] 


{T}U[1,M] 


(p-l) 


{T}U [-M,M] 
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The transition rules we obtain from these sets and values are the follow- 



ing. 



TT^TT 
IT^IT 



Tx^ Tx 
In-)- (n + l)T 
Ip^ Ip 



Vx G [-M, M] 
Vn G [-M, 0] 
Vp G [1,M] 



VnG [-M,0],Vp€ [2,M-1] 



raT— ^ nO 

nx^nx yxe[-M,M], 



pn^{n + — 1) 



Vp' G [1, M] 



We say that an agent in state x G [— M, M] has weight x and that an 
agent in state T has weight 0. Note that in the initial configuration the sum 
of the weights of all agents is exactly Y^aiXi. Note that any of the rule of 
our protocol does not modify the total weight of the population, i.e., at any 
step of the execution, the sum of the weights of all agents is exactly Sa^Xj. 

Note that the stable configurations, (i.e., the configurations where no 
rule can be applied to modify the state of some agent) , are the following: 

• each agent a is in some state n{a) G [— M, 0], 

• each agent a is either in some state p{a) G [1, M] or in state T. 

Note that no agent starts in state T, and that no rule enables the two 
interacting agents to enter the state T except for the rule TT — >■ TT. Thus, 
we know that it is impossible that all agents arc in state T. Consequently, 
in the last case described, we know that there is at least one agent in a state 



Note that in any stable configuration, all agents have the same output; 
if EajXj > 1 then all agents output 1, while in all the other cases, the agents 
output 0. 

Thus, if the population reaches a stable configuration, we know that 
the computed output is correct and that it will not be modified any more. 
Now, we should prove that the fairness condition ensures that we always 
reach a stable configuration. In fact, it is sufficient to prove that from 
any reachable configuration, there exists an execution that reaches a stable 
configuration. Indeed, since the number of configurations is finite, it means 
that in any execution, there is a stable configuration S such that from any 
reachable configuration, S is reachable. The fairness condition ensures that 
S is eventually reached. 

We now show that from any configuration, there exists an execution that 
leads to a stable configuration. 



pG [1,M]. 
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Consider any configuration reached during the execution. As long as 
there is an agent in state p G [1, M] and an agent in state n G [— M, —1], we 
apply pn — ?> {n + l){p — 1). Thus we can always reach a configuration where 
the states of all agents are in [— M, 0] U {T} if SajXj < 0, or in [0, M\ U {T} 
otherwise. 

If Sa,Xj < 0, then there is at least one agent in state n G [— M, 0], since 
all agents cannot be in state T. In this case, applying iteratively the rule 
nT nO, we reach a stable configuration where all agents have a state in 
[-M,0]. 

If SajXj > 1, then there is at least one agent in state p € [1, M]. If there 
is an agent in state 0, we apply the following rules. If there is no agent in 
state 1, we apply a rule pQ l{p — 1) for p G [2,M] to create a 1. Then, 
applying iteratively the rule 10 IT, we reach a stable configuration where 
each agent is either in a state in [1, M], or is in state T. 

This ends the proof of Proposition [3] when k = 1. 

A. 3 Proof of Our Protocol for Modulo Counting 

Here again, we use rules of the form np ^ {n + l){p — 1) mod k so that at 
the end of the computation there is only one node with a non-zero weight. 
We should also add some rules to be able to ensure the "broadcast" of the 
result among the agents. We consider two cases, depending on whether b is 
equal to zero or not. 

A. 3.1 Case 6 G [1,A; - 1]. 
Our protocol is defined as follows: 

• S = {CTI, . . . ,0-;}. 

• Q = {T}U[0,fe — 1], where T corresponds to a weight of but has a 
different output meaning than the state 0. 

• i(fTj) = aj mod k. 

• a;(T) = 1 and for any p G [0, /c — 1], = 1 if and only \{ p = b. 

Our protocol is deterministic and from Proposition [1] uniquely deter- 
mined by the sets Stable^ {q), Stable^ (q), and by the values max^{q), max^{q) 
defined as follows. In the following table, when p = k — 1 (resp. b = k — 1), 
p + 1 (resp. 6+1) should be understand as T. 



19 





Stable' (q) 


max' (q) 


Stable'^iq) 


max'^{q) 


T 


Q 




{T,0,6} 


1 





Q\{b} 


(k-l) 


[0, k-l] 





b 


{T}U [0,6-1] 


(b-l) 


{T}u[6 + l,fe-l] 


(^ + 1) 


pe[i,k-i]\{b} 


[0,p-l] 


(p-l) 


{T,0}U[p+l,fc-l] 


+ 



The transition rules we obtain from these sets and values are the follow- 
ing. 



TT ^ TT TO^- 00 

6T -> 6T 05^ T(A; - 1) if 6 = /c - 1 

OT ^ OT 06^(6 + 1) (A; - 1) \lb^k-l 
VpG [1,A;-1] 

Tp Tp pp'^ pp' Vp' G [0, p — 1] 

p{k-l)^T{p-l) pp'^{p' + l){p-l) 'ip'&\p,k-2] 
\/p G [0, A; - 1] \ {6} 

Op -)■ Op pT^ l{p - 1) 

Note that in the initial configuration the sum of the weights of all agents 
is exactly T,aiXi mod k. Note that the application of any rule of our protocol 
does not modify this value, i.e., at any step of the execution, the sum of the 
weights of all agents is exactly SajXj mod k. 

Note that the stable configurations, (i.e., the configurations where no 
rule can be applied to modify the state of some agent) , are the following: 

• there exists a unique agent in state b and all other agents are in state 
T. 

• there exists at most one agent in state p G [1, A: — 1] \ {b} and all other 
agents are in state 0. 

As in the protocols for threshold predicates, no rule can transform the 
states of two interacting agents into T except for the rule TT — )• TT. Since 
initially, no agent is in state T, it is impossible to reach a configuration 
where all agents are in state T. 

In any stable configuration, either all agents output 1 (if SajXi = b 
mod k), or all agents output 0. We now show that from any reachable 
configuration, we can reach a stable configuration. 

As long as there are two agents in states p,p' G [1, A; — 1] with p < p', 
we can apply iteratively the rule pp' — > (p' + l)(p — 1) between these two 
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agents. Doing so, either one agent enters state 0, or one agent is in state 
k — 1, while the other is in state p" G [1, A; — 1]. In the latter case, applying 
the rule p{k — 1) — )• T(p — 1), we also decrease the number of agents with a 
positive weight by 1. Thus, we can always reach a configuration where there 
is at most one agent a in state p G [l,k — 1], while all the other agents are 
in state or T. 

If TittiXi = mod k, then all agents are in state or T, and we know 
there is at least one agent in state 0. Applying as long as necessary the rule 
TO 00, we reach a stable configuration where all agents are in state 0. 

If TittiXi = p mod k with p G [1, A; — 1] \ {b} then one agent is in state p 
while all the other agents are in state or T. If there is an agent in state T, 
we apply the rule pT — >-l(p — 1). li p = 1, then there is one more agent in 
state 0. lip > 1, we apply the rule l{p — 1) — )• pO, to also get one more agent 
in state 0. Iterating this process, we reach a stable configuration where one 
agent is in state p while all other agents are in state 0. 

If TiUiXi = b mod k, then one agent is in state b while all the other agents 
are in state or T. As long as there is an agent in state 0, if 6 7^ A; — 1, we 
apply the rules Ob {b + l){k-l) and {b + l){k-l) ^Tb. Ub = k-1, we 
apply the rule 0(A; — 1) — )■ T(/c — 1). Doing so, we reach a stable configuration 
where one agent is in state b while all other agents are in state T. 

A.3.2 Case 6 = 0. 

If A; = 2, then [SajXj = 0[2]] is the negation of [SajXj = 1[2]]. In this 
case, since pavlovian protocols are closed under negation, we know from the 
previous case that there is a pavlovian protocol that computes [SajXj = 0[2]]. 

In the following, we assume that A; > 3. Our protocol is defined as 
follows: 

• S = {cJi, . . .,ai}. 

• Q = {A, B} U [0, A; — 1], where A and B corresponds to a weight of 
but has a different output meaning than the state 0. 

• t(cJi) = Oj mod k. 

• = 1 and for any 2; G [1, A; - 1] U {A, B}, oj{x) = 0. 

Our protocol is deterministic and from Proposition [T] uniquely deter- 
mined by the sets Stable^ (q), Stable^ (q), and by the values max^{q), max^{q) 
defined as follows. 
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qeQ 


stable^ (q) 


max^{q) 


Stahle^{q) 


max^{q) 


A 


Q\{B} 





Q\{B} 





B 


Q\{A} 





Q\{A} 








{A, B, 0,1, (k-l)} 


(k-l) 


[0. k-l] 





1 


{A} 


A 




2 


{k-l) 


Q\{{k-1)} 


{k-2) 


{B} 


B 


pe[2,k-2] 


{A,B}U[0,p-l] 




{A,B]V^\p+\,k-l] 


ip + l) 



The transition rules we obtain from these sets and values are the follow- 



ing. 



AA ^ AA 
AB 00 
AO GO 

Ap Ap Vj3e[l,fc-2] 

A{k - l)^B{k - 1) 



BA 00 

BB BB 

BO -> 00 

Bp Bp 



Ox Ox e {A,B,0,l} 

Op ^{p+l){k-l) Vpe[2,fc-2] 
O(fc-l)^. B{k-1) 



Ix lA 

Ip (p + 1)A 

l(fc-l)^ BA 



Vcc e {A,B,0} 
Vp e [1, fc - 2] 



Vp e[2,k- 1] 

px px Vx e U [0,p 

pn ->(n + l)(p-l) Vne[p, fc-2] 

p(fc-l)^ B(p-l) 



Note that in the initial configuration the sum of the weights of all agents 
is exactly SajXi mod k. Note that the application of any rule of our protocol 
does not modify this value, i.e., at any step of the execution, the sum of the 
weights of all agents is exactly SajXj mod k. 

Note that the stable configurations, (i.e., the configurations where no 
rule can be applied to modify the state of some agent) , are the following: 

• all agents are in state 0. 

• there exists a unique agent in state p G [l,k — 2] and all other agents 
are in state A. 

• there exists a unique agent in state p G [2, A: — 1] and all other agents 
are in state B. 

In any stable configuration, either all agents output 1 (if T,aiXi = b 
mod k), or all agents output 0. We now show that from any reachable 
configuration, we can reach a stable configuration. 
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As in the previous case, as long as there are two agents in states G 
[1, A; — 1] with p < p', we can apply iteratively the rule pp' (p' + l){p — 1) 
between these two agents. Doing so, either one agent enters state 1, or one 
agent is in state k — 1. If one agent is in state 1 while the other is in state 
k — 1, we apply the rule l{k — l) BA, and we have decreased the number 
of agents with a positive weight by 2. If there is one agent in state 1 (resp. 
A; — 1) while the other is in state p € [1, /c — 2] (resp. p £ [2,k — 1]), we apply 
the rule Ip ^ {p + 1)A (resp. p{k — 1) ^ B{p — 1)) to decrease the number 
of agents with a positive weight. Thus, we can always reach a configuration 
where there is at most one agent a in state p E [1, A; — 1], while all the other 
agents are in state 0, A or B. 

If TittiXi = mod k, either all agents have started in state or not. In 
the first case, the initial configuration was a stable configuration, and we 
have nothing to prove. In the second case, the last step before we reach a 
configuration containing only agents in state 0, A or B, there was one agent 
in state 1, one agent in state {k — 1) and the rule 1(A; — 1) ^ BA has been 
applied. Thus, either there exists an agent in state in the configuration, 
or there exists an agent in state A and an agent in state B. In the latter 
case, we can apply the rule AB 00 to be in a configuration containing 
agents in state 0. Then, applying the rules AO — > 00 and BO 00, we reach 
a stable configuration where all agents are in state 0. 

If TittiXi = 1 mod k (resp. SajXi = A; — 1 mod A), we reach a configu- 
ration where there is exactly one agent in state 1 (resp. A — 1) while all the 
other agents are in state 0, A or B. Then applying the rules IB lA and 
10 ^ IB (resp. A{k - 1) ^ B{k - 1) and 0(A - 1) ^ B{k - 1)), we reach a 
stable configuration where there is exactly one agent in state 1 (resp. A — 1) 
while all the other agents are in state A (resp. B). 

If T,aiXi = p mod A with p G [2, A — 2], we reach a configuration where 
there is exactly one agent in state p while all the other agents are in state 0, 
A or B. If the agents with weight are either all in state A, or all in state 
B, we are in a stable configuration. Otherwise, applying as long as possible 
the rules AB 00, Op ^ {p + 1)(A - 1) and {p + 1)(A - 1) ^ Bp, we reach 
a final configuration where exactly one agent is in state p while all the other 
agents are in state B. 
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